Oracle posterior contraction rates under hierarchical priors

نویسندگان

چکیده

We offer a general Bayes theoretic framework to derive posterior contraction rates under hierarchical prior design: the first-step serves assess model selection uncertainty, and second-step quantifies belief on strength of signals within chosen from first step. In particular, we establish non-asymptotic oracle (i) local Gaussianity condition log likelihood ratio statistical experiment, (ii) entropy dimensionality models, (iii) sufficient mass near best approximating signal for each model. The can be designed generically. distribution enjoys Gaussian tail behavior therefore resulting mean also satisfies an inequality, automatically serving as adaptive point estimator in frequentist sense. Model mis-specification is allowed these rates. unified attempt quantification experiments, easily verified various experiments considered [GvdV07a] beyond. results are applied problems including: trace regression, shape-restricted isotonic/convex high-dimensional partially linear (iv) covariance matrix estimation sparse factor model, (v) detection non-smooth polytopal image boundary, (vi) intensity Poisson process These new serve either theoretical justification practical proposals literature, or illustration generic construction scheme (nearly) minimax complicated experiment.

برای دانلود باید عضویت طلایی داشته باشید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Rates of Contraction of Posterior Distributions Based on Gaussian Process Priors

We derive rates of contraction of posterior distributions on nonparametric or semiparametric models based on Gaussian processes. The rate of contraction is shown to depend on the position of the true parameter relative to the reproducing kernel Hilbert space of the Gaussian process and the small ball probabilities of the Gaussian process. We determine these quantities for a range of examples of...

متن کامل

Optimal Bayesian posterior concentration rates with empirical priors

In high-dimensional Bayesian applications, choosing a prior such that the corresponding posterior distribution has optimal asymptotic concentration properties can be restrictive in the sense that the priors supported by theory may not be computationally convenient, and vice versa. This paper develops a general strategy for constructing empirical or data-dependent priors whose corresponding post...

متن کامل

Posterior Consistency in Nonparametric Regression Problems under Gaussian Process Priors

Posterior consistency can be thought of as a theoretical justification of the Bayesian method. One of the most popular approaches to nonparametric Bayesian regression is to put a nonparametric prior distribution on the unknown regression function using Gaussian processes. In this paper, we study posterior consistency in nonparametric regression problems using Gaussian process priors. We use an ...

متن کامل

Posterior Contraction Rates of the Phylogenetic Indian Buffet Processes.

By expressing prior distributions as general stochastic processes, nonparametric Bayesian methods provide a flexible way to incorporate prior knowledge and constrain the latent structure in statistical inference. The Indian buffet process (IBP) is such an example that can be used to define a prior distribution on infinite binary features, where the exchangeability among subjects is assumed. The...

متن کامل

Oracle Inequalities and Adaptive Rates

We have previously seen how sieve estimators give rise to rates of convergence to the Bayes risk by performing empirical risk minimization over Hk(n), where (Hk)k ≥ 1 is an increasing sequence of sets of classifiers, and k(n) → ∞. However, the rate of convergence depends on k(n). Usually this rate is chosen to minimize the worst-case rate over all distributions of interest. However, it would be...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: Electronic Journal of Statistics

سال: 2021

ISSN: ['1935-7524']

DOI: https://doi.org/10.1214/21-ejs1811